Group Invariant Dictionary Learning
نویسندگان
چکیده
The dictionary learning problem concerns the task of representing data as sparse linear sums drawn from a smaller collection basic building blocks. In application domains where such techniques are deployed, we frequently encounter datasets some form symmetry or invariance is present. Motivated by this observation, develop framework for dictionaries under constraint that blocks remains invariant symmetries. Our procedure relies on action matrix group acting data, and subsequently introducing convex penalty function so to induce sparsity with respect elements. specializes convolutional when consider integer shifts. Using properties positive semidefinite Hermitian Toeplitz matrices, an extension learns continuous numerical experiments synthetic ECG show incorporation symmetries priors most valuable dataset has few data-points, full range inadequately expressed in dataset.
منابع مشابه
Online Group-Structured Dictionary Learning Supplementary Material
Lemma 1. If ρ = 0, then Mt = M0 +M′t (∀t ≥ 1). When ρ > 0, then Mt = M ′ t (∀t ≥ 1). Proof. 1. Case ρ = 0: Since γt = 1 (∀t ≥ 1), thus Mt = M0 + ∑t i=1 Ni. We also have that ( i t 0 = 1 (∀i ≥ 1), and therefore M′t = ∑t i=1 Ni, which completes the proof. 2. Case ρ > 0: The proof proceeds by induction. • t = 1: In this case γ1 = 0, M1 = 0 × M0 + N1 = N1 and M′1 = N1, which proves that M1 = M ′ 1....
متن کاملCollaborative Filtering via Group-Structured Dictionary Learning
Structured sparse coding and the related structured dictionary learning problems are novel research areas in machine learning. In this paper we present a new application of structured dictionary learning for collaborative filtering based recommender systems. Our extensive numerical experiments demonstrate that the presented method outperforms its state-of-the-art competitors and has several adv...
متن کاملGroup-Invariant Cross-Modal Subspace Learning
Cross-modal learning tries to find various types of heterogeneous data (e.g., image) from a given query (e.g., text). Most cross-modal algorithms heavily rely on semantic labels and benefit from a semantic-preserving aggregation of pairs of heterogeneous data. However, the semantic labels are not readily obtained in many real-world applications. This paper studies the aggregation of these pairs...
متن کاملOnline Dictionary Learning with Group Structure Inducing Norms
• Sparse coding. • Structured sparsity (e.g., disjunct groups, trees): increased performance in several applications. • Our goal: develop a dictionary learning method, which – enables general overlapping group structures, – is online: fast, memory efficient, adaptive, – applies non-convex sparsity inducing regularization: ∗ fewer measurements, ∗ weaker conditions on the dictionary, ∗ robust (w....
متن کاملDictionary Learning with Mutually Reinforcing Group-Graph Structures
In this paper, we propose a novel dictionary learning method in the semi-supervised setting by dynamically coupling graph and group structures. To this end, samples are represented by sparse codes inheriting their graph structure while the labeled samples within the same class are represented with group sparsity, sharing the same atoms of the dictionary. Instead of statically combining graph an...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Signal Processing
سال: 2021
ISSN: ['1053-587X', '1941-0476']
DOI: https://doi.org/10.1109/tsp.2021.3087900